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Abstract 

This paper provides a tutorial overview of game theoretic techniques used for communication over 
frequency selective interference channels. We discuss both competitive and cooperative techniques. 
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I. Communication over interference limited channels 

The success of unlicensed broadband communication has led to very rapid deployment of communica- 
tion networks that work independently of each other using a relatively narrow spectrum. For example the 
802. llg standard is using the ISM band which has a total bandwidth of 60 MHz. This band is divided 
into 12 partially overlapping bands of 20 MHz. The success of these technologies might become their 
own limiting factor The relatively small number of channels and the massive use of the technology in 
densely populated urban metropolitan areas will cause significant mutual interference. This is especially 
important for high quality real time distribution of multi-media content that is intolerant to errors as well 
as latency. Existing 802.11 (WiFi) networks have very limited means to coordinate spectrum with other 
interfering systems. It would be highly desirable to improve the interference environment by distributed 
spectral coordination between the different access points. Another scenario is that of centralized access 
points such as 802.16 (WiMax) where the resources are allocated centrally by a single base station. 
Similar situation is facing the advanced DSL systems such as ADSL2-I- and VDSL. These systems are 
currently limited by crosstalk between the lines. As such the DSL environment is another example 
of highly frequency selective interference channel. While the need to operate over interference limited 
frequency selective channels is clear in many of the current and future communication technologies, the 
theoretical situation is much less satisfying. The capacity region of the interference channel is still open 
(see [1] for short overview) even for the fixed channel two user case. In recent years great advances 
in understanding the situation for flat channels under weak interference have been achieved. It can be 
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shown that in this case treating the interference as noise is almost optimal. On the other hand for the 
medium strength interference as is typical in the wireless environment, the simplest strategy is by using 
orthogonal signaling, e.g. TDMA/FDMA, for high spectral efficiency networks, or CDMA for very strong 
interference with low spectral efficiency per user. Moreover, sequential cancelation techniques that are 
required for the best known capacity region in the medium interference case ||2| are only practical for 
small number of interferers. The interference channel is a conflict situation, and not every achievable 
rate pair (from informational point of view) is actually reasonable operating point for the users. This 
conflict is the reason to analyze the interference channel using game theoretical tools. Much work has 
been done on competitive game theory applied to frequency selective interference channel, with the early 
works of Yu et al. |l3T| and subsequent works of Scutari et al. (see [41 and the references therein). A 
particularly interesting topic is the use of generalized Nash games to the weak interference channel [5j, 
and the algorithm in lO which extends the FM-IWF to iterative pricing under fixed rate constraint. 

The fact that competitive strategies can result in significant degradation due to the prisoner's dilemma 
has been called the price of anarchy Q. In the interference channel case, a simple case has been analyzed 
by Laufer and Leshem |8|, who characterized the cases of prisoner's dilemma in interference limited 
channels. To overcome the sub-optimality of the competitive approach we have two alternatives: Using 
repeated games or using cooperative game theory. Since most works on repeated games concentrated on 
flat fading channels, we will mainly concentrate on cooperative game theoretic approaches. One of the 
earliest solutions for cooperative games is the Nash bargaining solution ||9l- Many papers in recent years 
were devoted to analyzing the Nash bargaining solution for the frequency flat interference channel in the 
SISO llOi, HB, MISO 112, US and MIMO cases |I14|. Interesting extensions for log-convex utiUty 
functions appeared in ifTSl . Another interesting application of the bargaining techniques discussed here is 
for multimedia distribution networks. Park and Van der Schaar llT6l used both Nash bargaining and the 
generalized Kalai-Smorodinski solutions [il7il for multimedia resource management. Another alternative 
cooperative model was explored in ifTSl where, the cooperation between rational wireless players was 
studied using coaUtional game theory by allowing the receivers to cooperate using joint decoding. 

In the context of frequency selective interference channels much less research has been done. Han 
et al. |[T9l in a pioneering work, studied the Nash Bargaining under FDM/TDM strategies and total 
power constraint. Unfortunately, the algorithms proposed were only sub-optimal. Iterative sub-optimal 
algorithms to achieve Nash bargaining solution for spectrum allocation under average power constraint 
have been applied in [|20l . Only recently, we have managed to overcome the difficulties by imposing a 
total PSD mask constraint lIlTl . in order to obtain computationally efficient solutions to the bargaining 
problem in the frequency selective SISO and MIMO cases under TDM/FDM strategies. Furthermore, it 
can be shown ||22| that the PSD limited case can be used to derive a computationally efficient converging 
algorithm also in the total power constraint case. A very interesting problem is allowing the users to treat 
the interference as noise in some bands, while using orthogonal FDM/TDM strategies in others. This is a 
very challenging task, since the Nash bargaining solution involves a highly non-convex power allocation 
problem, instead of the simpler orthogonal signaling. 
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As discussed before, the frequency selective interference channel is very interesting both from practical 
point of view and from information theoretic point of view. We can show that it has many interesting 
aspects from game theoretic point of view, and that various levels of interference admit different types of 
game theoretic technique. The purpose of this paper is to provide an overview of the various game theoretic 
techniques involved in the analysis and algorithms used for frequency selective interference channels. 
We demonstrate how game theory can be applied in specific scenarios and discuss signal processing 
aspects of the required game theoretic solutions. Our main goal is to discuss in a tutorial manner some 
new applications of game theory to frequency selective interference channels. First, we outline various 
interference channel scenarios with emphasis on frequency selective channels. Then we discuss the basic 
concepts of game theory required for analyzing these channels: Nash equilibrium, strategies. Generalized 
Nash games and Nash bargaining theory. Using these concepts we discuss the specific translations into 
working strategies for the communication models and discuss important signal processing aspects such 
as spectrum sensing and centralized and distributed strategies. To wrap up the discussion with real life 
applications, end up with two case studies: DSL and WiMax where we demonstrate the gains of the 
techniques on real channels. We end up with conclusions and future research directions. 

II. Introduction to interference channels 

Computing the capacity region of the interference channel is an open problem in information theory 
|[23l . A good overview of the results until 1985 is given by van der Meulen lU and the references therein. 
The capacity region of general interference channel is not known yet. However, in the last forty five years 
of research some progress has been made. The best known achievable region for the general interference 
channel is due to Han and Kobayashi lU. The computation of the Han and Kobayashi formula for a 
general discrete memoryless channel is in general too complex. Recently large advance in obtaining upper 
bounds on the rate region have been obtained especially for the case of weak interference. 

A 2x2 Gaussian interference channel in standard form (after suitable normalization) is given by: 

1 ai 
^ a2 1 

where, s = [si,S2]"^> and x = [xi,X2]^ are sampled values of the input and output signals, respectively. 
The noise vector n represents the additive Gaussian noises with zero mean and unit variance. The powers 
of the input signals are constrained to be less than Pi,P2, respectively. The off-diagonal elements of 
H, ai,a2 represent the degree of interference present. The major difference between the interference 
channel and the multiple access channel is that both encoding and decoding of each channel are performed 
separately and independently, with no information sharing between receivers. 

The capacity region of the Gaussian interference channel with very strong interference (i.e., ai > 
"2 > 1 + -P2 ) is given by ^ 

R^<log2il + P^), i = l,2. (2) 



Hs + n, H 



(1) 
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This surprising result shows that very strong interference dose not reduce the capacity of the users. A 
Gaussian interference channel is said to have strong interference if minjai, > 1- Sato |[25l derived an 
achievable capacity region (inner bound) of Gaussian interference channel as intersection of two multiple 
access Gaussian capacity regions embedded in the interference channel. The achievable region is the 
intersection of the rate pair of the rectangular region of the very strong interference (H) and the following 
region: 

Ri + R2< log2 (mill {1 + Pi + aP2, 1 + P2 + pPi}) • (3) 

While the two user flat interference channel is a well studied (although not solved) problem, much less 
is known in the frequency selective case. An N x N frequency selective Gaussian interference channel 
is given by: 



XA; = HfcSfc + nfc k = l,...,K 
hiiik) ... hiN{k) 



(4) 



hNi{k) ... hNN{k) 

where, s^, and are sampled values of the input and output signal vectors at frequency k, respectively. 
The noise vector represents an additive white Gaussian noise with zero mean and unit variance. The 
power spectral density (PSD) of the input signals are constrained to be less than pi{k),p2{k) respectively. 
Alternatively, only a total power constraint is given. The off-diagonal elements of H^, represent the degree 
of interference present at frequency k. The main difference between interference channel and a multiple 
access channel (MAC) is that in the interference channel, each component of Sk is coded independently, 
and each receiver has access to a single element of x^. Therefore, iterative decoding schemes are much 
more limited, and typically impractical for large number of users. 

To overcome this problem there are two simple strategies. When the interference is sufficiently weak, 
the common wisdom is to treat the interference as noise, and code at a rate corresponding to the total 
noise. When the interference is stronger, i.e. Signal to Interference Ratio (SIR) is significantly lower than 
Signal to additive Noise Ratio (SNR), treating the interference as noise can be highly inefficient. One of 
the simplest ways to deal with medium to strong interference channels is through orthogonal signaling. 
Two extremely simple orthogonal schemes are using FDM or TDM strategies. These techniques allow 
a single user detection (which will be assumed throughout this paper) without the need to complicated 
multi-user detection. The loss of these techniques compared to techniques requiring joint decoding has 
been thoroughly studied, e.g., ll24l in the constant channel case, showing degradation compared to the 
techniques requiring joint or sequential decoding. However, the widespread use of FDMA/TDMA as well 
as collision avoidance medium access control (CSMA) techniques, make the analysis of these techniques 
very important from practical point of view as well. For frequency selective channels (also known as ISI 
channels) we can combine both strategies by allowing time varying allocation of the frequency bands to 
the different users as shown in figure |l(b)| 
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(a) Interference channel 



(b) TDMA and joint TDMA/OFDMA 



Fig. 1. (a) Standard form interference channel, (b) TDMA and joint TDMA/OFDMA 



In this paper we limit ourselves to joint FDM and TDM scheme where an assignment of disjoint 
portions of the frequency band to the several transmitters is made at each time instance. This technique 
is widely used in practice because simple filtering can be used at the receivers to eliminate interference. 
All of these schemes as to operate under physical and regulation constraint like Average power constraint 
or/and PSD mask constraint. 



III. Basic concepts of cooperative and competitive game theory 

In this section we review the basic concepts of game theory in an abstract setting. Our focus is on 
concepts that have been found to be relevant to the frequency selective interference channel. We begin 
with competitive game theory and then continue to describe the cooperative solutions. The reader is 
referred to the excellent books of |[26l . |[27l and |[28l for more details and for proofs of the main results 
mentioned here. 



A. Static competitive games and the Nash equilibrium 

An static N player game in strategic form is a three tuple {N, A, u) composed of a set of players 
{1, A^}, a set of possible combinations of actions of each player denoted by ^ = 11^=1 ^n, where An 
is the set of actions for the re'th player and a vector utility function u = [ui, mat], where Un{ai, ...,aj\f) '■ 
Y[n=i ^n^T^ is the utiUty of the n'th player when strategy vector a = (oi, ajs) has been played. The 
interpretation of Un is that player n receives a payoff of u„(ai, otv) when the players have chosen 
actions ai, ...,aAr. The game is finite when for all n, An is a finite set. 

A special type of competitive games are the constant sum games. A game is constant sum, if for all 
action vectors a, 'Ylin=i ^n(^) = c for some constant c. When the game is constant sum we can subtract 
c/N from each utility and obtain a zero sum game that has the same properties as the original game. A 
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two players zero sum game is strictly competitive since anything gained by one player leads to a loss to 
the other player. 

An important notion of solution relevant to games is that of a Nash equilibrium. 

Definition 3.1: A vector of actions a = (ai, ...,aAr) G ^ is a Nash equilibrium in pure strategies if 
and only if for each player 1 < n < and for every a' = (a'^, a'^) such that = a^ for all i 7^ n 
and 7^ a„ we have u„(a') < ii„(a), i.e., each player can only loose by deviating by itself from the 
equilibrium. 

The Nash equilibrium in pure strategies does not always exist as the following example shows: 

Example I - A game with no pure strategy Nash equilibrium: Consider the two players game defined 
by the following: Ai = {0,1}. Ui{ai,a2) = ai © 02 © (i — 1), i.e., the first player payoff is 1 when 
actions are identical and otherwise, while the second player's payoff is 1 when the actions are different 
and otherwise. Clearly, this game also known as matching pennies has no Nash equilibrium in pure 
strategies, since always one of the players can improve his situation by changing his choice. 
Even when it exists, the Nash equilibrium in pure strategies is not necessarily unique, as the following 
example shows: 

Example II - A communication game with infinitely many pure strategy NE. Assume that two users are 
sharing an AWGN multiple access channel (i.e., the accss point can perform joint decoding of the users) 

y = X1+X2 + z, (5) 



where z N{0, cj^) is a Gaussian noise random variable. Each user has power P. It is well known |[23l 
that the rate region of this multiple access channel is given by a pentagon defined by: 

Ri < ilog(l + ^) =C'"^^ 

R2<^log{l + ^) =C"^^^ (6) 
Ri + R2< ilog(l + ^) =Ci,2. 

The corners A, B (see figure |2(a)]) of the pentagon are A = (C""^^, C™°) and B = (C"^''^, C™^^) , where 
C™™ = ^ log ^1 + p^„2 ^ , is the rate achievable by assuming that the other user's signal is interference. 
Note that any point on the line connecting the points A, B is achieved by time sharing between these 
two points. Each player n = 1, 2 can choose a strategy < a„ < 1 that is the time sharing ratio between 
coding at its rate at point A or B. The payoff in this game is given by 

, , / a„C-- + (1 - an)C^'' if ai + 02 < 1 
n„(Qi,a2) = < (7) 
I otherwise. 

The reason that the utility is when ai + a2 > 1 is that no reliable communication is possible, since the 
rate pair achieved is outside the rate region. In this game any valid strategy point such that oi + 02 = 1 is 
a Nash equilibrium. If user n reduces its a„ obviously its rate is lower since he transmits larger fraction 
of the time at the lower rate. If on the other hand he increases a„ then ai + a2 > 1 and both players 
achieve 0. Hence the AWGN MAC game has infinitely many Nash equilibrium points. Similar game has 
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been used in |f29l where the fact that infinitely many NE points exist is shown. It is interesting to note 
that a similar MAC game for the fading channel has a unique Nash equilibrium point |[30l . 

To better understand this game, we might look at the best response dynamics. Best response action 
is the attempt of a player to maximize its utility against a given strategy vector. It is a well established 
mean of distributively achieving the Nash Equilibrium. In the context of information theory, this strategy 
has been termed Iterative Water-Filling (IWF) 13J. If in the multiple access game the players use the best 
response simultaneously, the first step would be to transmit at C™^^. Each player then receives utility 
and in the next step reduces its rate to C™™, and vice versa. The iteration never converges and the utility 
of each player is given by ^C™™, worse than transmitting constantly at (7™™. Interestingly in this case, 
the sequential best response leads to one of the points A, B, which are the (non axis) comers of the rate 
region. The moral of this example is that using the best response strategy should be done carefully even 
in multiple access scenario's such as in |[3T1 . 

B. Pure and mixed strategies 

To overcome the first problem of no equiUbrium in pure strategies, the notion of mixed strategy has 
been proposed. 

Definition 3.2: A mixed strategy vr^ for player n is a probability distribution over An. 
The interpretation of the mixed strategies is that player n chooses his action randomly from A^ according 
to the distribution 7r„. The payoff of player n in a game where the mixed strategies tti, vtat are played 
by the players is the expected value of the utility 

Uni-n-i, ...,vrAr) = Et,^ 

X ... XTTjv [Un{xi, ...,Xn)] ■ (8) 

Example 111: Mixed strategies in random access game over multiple access channel To demonstrate the 
notion of mixed strategy, we now extend the multiple access game, into a random multiple access game, 
where the players can choose with probability p„ of working at rate C™™ and I — Pn working at C"^^^. 
This replaces the synchronized TDMA strategy in the previous game, with slotted random access protocol. 
This formulation, allows for two pure strategies corresponding to the comer points A, B and the mixed 
strategies amount to randomly choosing between these points. This game is a special case of the chicken 
dilemma (a termed proposed by B. Russel, |[32T|), since for each user it is better to chicken out, then to 
obtain zero rate, when both players choose the tough strategies. Obviously from the previous discussion, 
the points (C™^"", C™™) and (C™™, C™'^'') are Nash equilibria. Simple computation shows that there is 
a unique Nash equilibrium in mixed strategy corresponding to pi = P2 = (7^^/(7™^^. Interestingly the 
rates achieved by this random access (mixed strategy) approach is exactly (C™™,C™™), i.e., the price 
paid for random access is that both players achieve their minimal rate, so simple p-persistent random 
access provides no gain for the multiple access channel. Following Papadimitriou I?;] we can call this 
the price of random access. 
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TABLE I 

Payoffs in the multichannel random access game 



I\II 





1 









1 




(0,0) 




(a) Multiple Access game 




(b) Prisoner's dilemma regions 



Fig. 2. (a) Multiple Access Game with infinitely many pure strategy equilibria. Note that the parallel best response dynamics 
leads to unstable dynamics while the serial best response leads to one of two extremal NE points, (b) Graph of /lumi , /iiim2 
Vs. SNR, The solid line corresponds to /iiimi and the dashed line corresponds to h\im2 (U- 



C. convex games 

An important special type of games which is important for the spectrum management problem is that 
of convex competitive games. 

Definition 3.3: An N player game {N,A, U) is convex if each An is compact and convex and each 
Un{xi, is a convex function of Xn for every choice of {xj : j / n}. 

Convex games always have Nash equilibrium ||33l . A simple proof can be found in [21]. Convex 
competitive games are especially important in the context of spectrum management, since the basic 
Gaussian interference game forms a convex game. 

D. The prisoner's dilemma 

The prisoner's dilemma game is the major problem of the competitive approach. It was first described 
by Flood and Dresher in 1950 almost immediately after the concept of Nash equilibrium was published 
|[9ll . For an overview of the prisoner's dilemma and its history see the excellent book of Poundstone ll32l 
or in this journal |[34l . It turns out that this game has a unique Nash equilibrium which is the stable point 
of the game. Moreover this outcome is suboptimal to all player. The emergence of the prisoner's dilemma 
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in simple symmetric interference channels has been discussed in |8]. In ifTOl . ||2TI characterization of 
cases where cooperative solutions are better for general interference channels have been demonstrated. 
We briefly describe a simple case where the prisoner's dilemma occurs HI. We assume a simplified two 
players game. The game is played over two frequency bands each with symmetric interference channel. 
The channel matrices of this channel are H(l) = H(2) = H where 

|/112(1)P = |/i2l(l)|' = |/il2(2)P = 1/121 (2)P = h 

and hii{k) = 1. We limit the discussion to < /i < 1. In our symmetric game both users have the same 
power constraint P and the power is allocated by = (1 — a)P,pi{2) = aP,p2{l) = (3P,p2{2) = 

(1 — /3)P. We assume that the decoder treats the interference as noise and cannot decode it. The utility 
for user I given power allocation parameters a, /? is given by its achievable rate 



(1-a) \ 1 / a 
^ ^ SNR-^ + (5-h J + 2 + SNR-^ + {I - (3) ■ h 



(9) 



and similarly for user II, we replace a, [3. The set of strategies in this simplified game is {a, /3 : < a, /3 < 1}. 
There are four alternatives outcomes: 

• Both users select FDM resulting in q = /? = 0. This is the reward (R) for cooperation. 

• Player I selects FDM while user II selects competitive approach (IWF) resulting in a = , /? = 
(1 — h)/2 is the result of waterfiUing by user II when a = 0). This is when player I is naive (N) 
and the temptation for player II (T) 

• Player I selects IWF while user II selects FDM resulting in a = (1 — /i)/2 , /3 = 0. This is the 
temptation for player I (T) and player II is the naive (N). 

• Both players select IWF resulting in a = /3 = ^. This is the penalty for not cooperating (P). 
Table |II] describes the payoffs of users I at four different levels of mutual cooperation (The payoffs of user 
n are the same with the inversion of the cooperative/competetive roles). A prisoner's dilemma situation 

TABLE II 

User I payoffs at different levels of mutual cooperation 



user II is fully cooperative 

(/3 = 0) 



user II is fully competing 



(2a-l)h + l 
2 



user I is fully cooperative 

(a = 0) 



i log2 (1 + ■ 



2 loga ( 1 + ft 



user I is fully competing 

_ (2£-l)h+l^ 



loga 1 + 



1 + h 
2 

SNR-^ 



+ k log, 1 + 



2 

SNR-'^ + h 



log, 1 + 



SNR- 



is defined by the following payoff relations for both players - T > i? > P > A^. It is easy to show that 
the Nash equilibrium point in this case is that both players will defect (P). This is caused by the fact that 
given the other user act the best response will be to defect (since T > R and P > N). Obviously a better 
strategy (which makes this game a dilemma) is mutual cooperation (since R > P). We can now analyze 
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this simple game. It turns out that there are two functions, hiiai^{SNR),hiiai2iSNR) as described in 
Figure |2(b)| and only three possible situations lH : 

. (A) T > P > > iV , for /l< hiirn,- 

. (B) T > R> P > N ,for h^^^ <h< hum,- 

. (C) T > P > iV > P , for /iiijn, < h. 
The payoff relations in (A) corresponds to a game called "Deadlock". In this game there is no dilemma, 
since no matter what the other player does, it is better to defect (T > R and P > N), so the Nash 
equilibrium point is P. Since P > R thus there is no reason to cooperate. The maximum sum rate is 
also P because 2 ■ R > T + N and P > R. The payoff relations in (B) correspond to the prisoner's 
dilemma situation. While the Nash equilibrium point is P, each user's maximum payoff is achieved by 
R. In this region the FDM strategy will achieve the individual maximum rate. The last payoff relations 
(C) corresponds to a game called "Chicken". This game has two Nash equilibrium points, T and N. This 
is caused by the fact that for each of the other player's strategies the opposite response is preferred (if 
the other cooperates it is better to defect since T > R, while if the other defects it is better to cooperate 
since N > P). The maximum rate sum point is still at R (since R > P and 2 ■ R> T + N) thus, again 
FDM will achieve the maximum rate sum while IWF will not. 

E. Generalized Nash games 

Games in strategic forms are very important part of game theory, and have many applications. However, 
in some cases the notion of a game does not capture all the complications involved in the interaction 
between the players. Arrow and Debreu li35l defined the concept of a generalized Nash game and general- 
ized Nash equilibrium. In strategic form games, each player has a set of strategies that is independent from 
the actions of the other players. However, in reality sometimes the actions of the players are constrained 
by the actions of the other players. The generalized Nash game or abstract economy concept, captures 
exactly this dependence. 

Definition 3.4: A generalized Nash game with N players, is defined as follows: For each player n 
we have a set of possible actions X„ and a set function Kn ■ Ylmy^n ■^'^ri—'-Pi^n) where P{X) is the 
power set of X, i.e, Kn {{xm : m ^ n)) C X„ defines a subset of possible actions for player n when 
other players play {xm : n). lin(x) is a utility function defined on aU tuples {xi,...,xn) such that 
Xn G Kn{xm : m / n). 

Similarly to the definition of a Nash equilibrium, we can define a generalized Nash equilibrium: 

Definition 3.5: A generalized Nash equilibrium is a point x = (xi, ...,xn) such that for all n G 

Kn {{xm : m / n)), and for all y = {yi, ...,yn) such that y„ G Kn{{xm : m ^ n)) and ym = Xm for 
m^n ^^(x) > Uniy). 

Arrow and Debreu |[35l proved the existence of a generalized Nash equilibrium under very limiting 
conditions. Their result was generalized, and currently the best result is by Ichiishi ll36l . This result can 
be used to analyze certain fixed rate and margin versions of the iterative water-filling algorithm |i5l as 
will be shown in the next section. 
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F. Nash bargaining theory 

The "Prisoner Dilema" highlights the drawbacks of competition, due to mutual mistrust of players. 
We therefore ask ourselves when would a cooperative strategy be preferable to a competitive strategy. It 
is apparent that the essential condition for cooperation is that it should generate a surplus, i.e. an extra 
gain which can be divided between the parties. Bargaining is essentially the process of distributing the 
surplus. Thus, bargaining is foremost, a process in which parties seek to reconcile contradictory interests 
and values. The main question is if all players commit to following the rules, what reasonable outcome 
is acceptable by all parties. Therefore, the players have to agree on a bargaining mechanism which they 
will not abandon during the negotiations. The bargaining results may be affected by several factors like 
the power of each party, the amount of information available to each of the players, the delay response of 
the players, etc. Nash jOl, |[37l introduced an axiomatic approach that is based on properties that a valid 
outcome of the bargaining should satisfy. This approach proved to be very useful since it succeeded in 
choosing a unique solution through a small number of simple conditions (axioms), thus saving the need 
to perform the complicated bargaining process, once all parties accept these conditions. 

We now define the bargaining problem. An n-player bargaining problem is described as a pair {S, d), 
where S" is a convex set in n-dimensional Euclidean space, consisting of all feasible sets of n-players 
utilities that the players can receive when cooperating, d is an element of S, called the disagreement 
point, representing the outcome if the players fail to reach an agreement, d can also can be viewed as 
the utilities resulting from non-cooperative strategy (competition) between the players, which is a Nash 
Equilibrium of a competitive game. The assumption that 5 is a convex set, is a reasonable assumption 
if both players select cooperative strategies, since, the players can use alternating or mixed strategies to 
achieve convex combinations of pure bargaining outcomes. Given a bargaining problem we say that the 
vector u G S is Pareto optimal if for all w e 5 if w > u (coordinate wise) then w = u. A solution 
to the bargaining problem is a function F defined on all bargaining problems such that F {{S,d)) € S. 
Nash's axiomatic approach is based on the following four axioms that the solution function F should 
satisfy: 

Linearity (LIN). Assume that we consider the bargaining problem {S', d') obtained from the problem 
{S,d) by transformations: = anSn + l^m n = 1, A^. d'^ = andn + Pn- Then the solution 
satisfies Fi {{S', d')) = a„F„ {{S, d)) + /?„, for all n = 1, N. 

Symmetry (SYM). If two players m < n are identical in the sense that S is symmetric with respect 
to changing the m'th and the n'th coordinates, then Fm {{S, d)) = Fn ((S, d)). Equivalently, players 
which have identical bargaining preferences, get the same outcome at the end of the bargaining 
process. 

Pareto optimality (PAR). If s is the outcome of the bargaining then no other state t exists such that 
s < t (coordinate wise). 

Independence of irrelevant alternatives (IIA). If 5* C T and if F{{T,d)) = (11^,^2) € S, then 
F{{S,d)) = iul,u*^). 
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Surprisingly these simply axioms fully characterize a bargaining solution titled Nash's Bargaining 
solution. Nash's theorem may be stated as follows 

Based on this axioms and definitions we now can state Nash's theorem. 

Theorem 3.1: Assume that for all S is compact and convex, then there is a unique bargaining solution 
F{{S,d)), satisfying the axioms INV, SYM, IIA, and PAR, which is given by 

N 

F {{S,d)) = {si, ..,sn) = ai'g max TT (sn - d„) . (10) 

{di,..,dN)<{si,..,SN)€S ^J-^ 

Before continuing the study of the bargaining solution, we add a cautionary word. While, Nash's 
axioms are mathematically appealing, they may not be acceptable in some scenarios. Indeed various 
alternatives to these axioms have been proposed that lead to other solution concepts. Extensive survey 
of these solutions can be found in |17|. In the communication context, the axioms proposed by Boche 
at. el. ifTTI lead to a generalized NBS solution. More results of generalized bargaining for frequency 
selective channels will be discussed in [22] . To demonstrate the use of the Nash bargaining solution to 
interference channels, we begin with a simple example for flat channels. 

Example III: Consider two players communicating over a 2x2 memoryless Gaussian interference 
channel with bandwidth W = I, as described in ([T] Assume for simplicity that Pi = P2 = P- We 
assume that no receiver can perform joint decoding, and the utility of player n, f7„, is given by the 
achievable rate Similarly to the prisoner's dilemma example, if the players choose to compete then 
the competitive strategies in the interference game are given by flat power allocation and the resulting 
rates are given by Rnc = l/21og2 + T+^p)- Since the rates Rnc are achieved by competitive 
strategy, player n would cooperate only if he will obtain a rate higher than RnC- The game theoretic 
rate region is defined by pair rates higher than the competitive rates Rnc (see figure |3(b)| ). Assume that 
the players agree on using only FDM cooperative strategies, i.e. player n uses a fraction of < pn < 1 
of the band. If we consider only Pareto optimal strategy vectors, then obviously p2 = 1 — pi. The rates 
obtained by the two users are given by Rn{pn) = ^ log2 (^1 + y-^- The two users will benefit from 
FDM type of cooperation as long as 

RnC<Rn{pi), n=l,2. (11) 

The FDM Nash bargaining solution is given by solving the problem 

maxFip) = max(i?i(/5) - Ric) {R2{p) - R2c) ■ (12) 
p p 

The cooperative solution for this flat channel model was derived in lITOl . |[2TI . 

IV. Application of game theory to frequency selective interference channels 

In this section we apply the ideas presented in previous sections to analyze the frequency selective 
interference game. We provide examples for both competitive and cooperative game theoretic concepts. 
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A. Waterfilling based solutions and the Nash equilibrium 

To analyze the competitive approach to frequency selective interference channels, we first define the 
discrete-frequency Gaussian interference game which is a discrete version of the game defined in IS. 
Let /o < • • • < /i^ be an increasing sequence of frequencies. Let Ik be the closed interval given by 
Ik = [/fc-i) fk]- We now define the approximate Gaussian interference game denoted by Gl^j^ j^^y 

Let the players 1, . . . , operate over K parallel channels. Assume that the K channels have coupling 
functions hij{k). Assume that user i is allowed to transmit a total power of Pi. Each player can transmit a 
power vector p„ = {pn{'\.), ■ ■ ■ ,Pn{K)) G [0, Pn]^ such that Pn{k) is the power transmitted in the interval 
Ifc. Therefore we have Ylk=iPn{f^) = Pn- The equality follows from the fact that in a non-cooperative 
scenario all users will use all the available power. This implies that the set of power distributions for all 
users is a closed convex subset of the hypercube n^=i[*-'' Pn]^ given by: 

N 

B = J]b„ (13) 

n=l 

where B„ is the set of admissible power distributions for player n given by: 

B„ = [0,Pnf n |(p(l), . . . ,p{K)) : J2p{k) = P„| (14) 
Each player chooses a PSD p„ = {pn{k) : I < k < N) e B„. Let the payoff for user i be given by: 

C„ (P. , . . . ■ P.) = g log, (^1 + ^ |/.,..,.(^ + .?.(^ ) 

where C„ is the capacity available to player n given power distributions pj^, . . . , p^, channel responses 
hn{f), crosstalk coupling functions hmn{k) and a^{k) > is external noise present at the z'th channel 
receiver at frequency k. In cases where a'^{k) = capacities might become infinite using EDM strategies, 
however this is non-physical situation due to the receiver noise that is always present, even if small. Each 
Cn is continuous in all variables. 

Definition 4.1: The Gaussian Interference game G/j/^ = {A^, B, C} is the N players non-cooperative 
game with payoff vector C = (Ci, . . . , C^r) where C„ are defined in ([T5] ) and B is the strategy set defined 
by (Hai. 

The interference game is a convex non-cooperative N-persons game, since each Bj is compact and 
convex and each Cn{Pi, p^v) is continuous and convex in p„ for any value of {p^j 7^ n}- Therefore 
it always has a Nash equilibrium in pure strategies. A presentation of the proof in this case using 
waterfilling interpretation is given in |[38l . 

A much harder problem is the uniqueness of Nash equilibrium points in the water-filling game. This 
is very important to the stability of the waterfilling strategies. A first result in this direction has been 
given in ||39l . A more general analysis of the convergence has been given in |[3l, POl . fln . B2l and 
fl3l . Even the uniqueness of the Nash equilibrium, does not imply a stable dynamics. Scutari et al. llH 
provided conditions for convergence. Basically, they use the Banach fixed point theorem, and require that 
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the waterfilling response will be a contractive mapping. The waterfilling process has several versions: 
The sequential IWF is performed by a single player at each step. The parallel IWF is performed 
simultaneously by all players at each step, and the asynchronous IWF is performed in an arbitrary 
order. For good discussion of the convergence of these techniques see [4J. It should be emphasized that 
some conditions on the interference channel matrices are indeed required. A simple condition is strong 
diagonal dominance lH, and other papers relaxed these assumptions. In all typical DSL scenarios, the 
IWF algorithms converge. However, the convergence conditions are not always met, even in very simple 
cases, as the following examples shows: 

Example IV - Divergence of the parallel IWF. We consider a Gaussian interference game with 2 
tones and 3 players. Each player has total power P. The signal received by each receiver is just 
yn{k) = X]m=i ^m{k) + Zn{k) whcrc Zn{k) N (O, cj^(A;)), where the noise in the second band is stronger 
satisfying o"^(2) = P + (T^(1). We assume simultaneous waterfilling is performed (Similar examples can 
be constructed for the sequential IWF algorithm, but they are omitted due to space limitations). At the 
first stage, all users put all their power into frequency 1, by the first inequality. At the second stage all 
users see noise and interference power of 2P + (T^(1) at the first frequency, while the interference at the 
second frequency is (T^(2) = P+a'^{l). Since even when all power is put into frequency 2 the total power 
+ noise is below the noise level at frequency 1 all users will move their total power to frequency 2. This 
will continue, with all users alternating between frequenies simultaneously. The average rate obtained by 
the simultaneous iterative waterfilling is 



Nash equilibrium exists in this case, for example, two users use frequency 1 and one user uses frequency 
2 resulting in a rate 



for each user. 

The previous example demonstrated a simple condition where one of the water-filling schemes diverges. 
However, there are multiple NE points. The situation can be even worse. The following channel is a 
frequency selective channel, with a single NE in the Gaussian interference game. However non of the 
water filling schemes converges. 

Example V - Divergence of all waterfilling approaches. We provide now a second example, where both 
the sequential and the parallel IWF diverge, even though there is a unique NE point. Assume that we 
have two channels where the channel matrices H(/c), k = 0,1 are equal and given by: 



_ 2 1 _ 

and the noise at the first tone is o"^ and at the second tone + P. Each user has total power P. This 
situation might occur when there is a strong interferer at tone 2 while the receivers and transmitters are 





1 2 



H(A;) 



2 1 



(16) 
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(a) Channel where the IWF fails to converge 



(b) Game theoretic rate region 



Fig. 3. (a) A frequency selective channel with unique NE, where both sequential and parallel IWF diverge. (b)The Game 
Theoretic Rate region is defined by the set of rates which are better than the competitive equilibrium. The boundary of the 
region is exactly the set of Pareto-optimal points. The Hyperbola tangent to the rate region defines the Nash bargaining solution. 

located on the sides of a triangle, each user transmitting to a receiver near the next transmitter as in 
figure |3(a)[ When the first user allocates its power it puts all its power at the first frequency. The second 
user chooses tone 2. The third player puts all its power at frequency 1, but this generates interference to 
user 1 which migrates to frequency 2 and we obtain that the users change their transmission tone at each 
step. In the simultaneous IWF all users will choose channel 1 and then migrate together to channel 2 and 
back. It is interesting that this game has a unique equilibrium, where each user allocates two thirds of 
the power to frequency 1 and one third of the power to frequency 2. Still all iterative schemes diverge. 

B. Pricing mechanisms for regulating distributed solutions 

To overcome some of the problems of the competitive behavior, regulation can play an important role. 
A generalization of the RA-IWF algorithm is the band preference (BPSM) algorithm ll44ll in which each 
user solves the following problem in parallel (or sequentially) to the other users: 



In the BPSM algorithm the total rate is replaced by a weighted sum of the rates at each frequency. The 
weights can be provided by the regulator to limit the use of certain bands by strong users, so that users 
that suffers severe interference but do not affect other users will be protected. This results in waterfiUing 
against a compensated noise level. 

Alternative approach to the BPSM is using generahzed Nash games. The basic approach has been 
proposed in lO and termed Fixed Margin IWF Each user has both power constraint, a target noise 
margin and a desired rate. The user minimizes its power as long as it achieves its target rate. This is a 



™8'^P,.(i),--,p™(-R') 
Subject to 




(17) 



Pn = J2k=lPn{k) . 
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generalized Nash game, first analyzed by Pang et al. HI, who provided the first conditions for convergence. 
Noam and Leshem [6| proposed a generaUzation of the FM-IWF termed Iterative Power Pricing (IPP). 
In their solution, a weighted power is minimized, where frequency bands which have higher capacity are 
"reserved" to players with longer lines, through a line dependent pricing mechanism. The users iteratively 
optimize their power allocation so as their rate and total power constraint are maintained while minimizing 
the total weighted power. It can be shown that the conditions of Pang et al. can also be used to analyze 
the IPP algorithm. For both the BPSM and the IPP approaches, simple pricing schemes that are adapted 
to the DSL scenario have been proposed. The general question of finding good pricing schemes is still 
open, but would require to combine physical modeling of the channels as well as insight into the utilities 
as function of the desired rate. Even the autonomous spectrum balancing algorithm (ASB) ||45]| can be 
viewed as a generalized Nash game, where the utility is given by the rate of a fictitious reference line, 
and the strategy sets should satisfy both rate and power constraint. The drawback of the ASB approach 
here, is finding a reference line which serves as a good utility function. 

C. Bargaining over frequency selective channels under mask constraint 

In this section we define the cooperative game corresponding to the joint FDM/TDM achievable rate 
region for the frequency selective N— user interference channel. For simplicity of presentation we limit 
the derivation to the two player case under PSD mask constraint. In 1191 Nash bargaining solution was 
used for resource allocation in OFDMA systems. The goal was to maximize the overall system rate, 
under constraints on each users minimal rate requirement and total transmitted power. However, in that 
paper the solution was used only as a measure of fairness. Therefore, the point of disagreement was not 
taken as the Nash equilibrium for the competitive game, but an arbitrary Rmin was used. This can result 
in a non-feasible problem, and the proposed algorithm might become unstable. An alternative approach is 
based on PSD mask constraint |[2ll in conjunction with general bargaining theory originally developed by 
Nash (|[9l. ll37l ). Based on the solution for the PSD limited case, computing the Nash Bargaining solution 
under total power constraint can then be solved efficiently as well |[22l . In order to keep the discussion 
simple we concentrate the discussion on the two user PSD mask hmited case. 

In real applications, the regulator limits the PSD mask and not only the total power constraint. Let 
the K channel matrices at frequencies k = 1,...,K be given by (H^ : k = I, ...,K). Player is allowed 
to transmit at maximum power pn (k) in the k'th frequency bin. In competitive scenario, under mask 
constraint, all players transmit at the maximal power they can use. Thus, player n choose the PSD, 
Pn = {Pn{k) ■ ^ < k < K). The payoff for user n in the non-cooperative game is therefore given by: 

RnC (P) = E log, f 1 + 2,,, l • (18) 

^ \ Em^n \hnm{WPm{k) + ai{k) J 

Here, Rnc is the capacity available to player n given a PSD mask constraint distributions p. (j'^{k) > 
is the noise presents at the n'th receiver at frequency k. Note that without loss of generality, and in 
order to simplify notation, we assume that the width of each bin is normalized to 1. We now define the 
cooperative game GtfC^, K, p). 
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Definition 4.2: The FDM/TDM game GtfC^, K,p) is a game between 2 players transmitting over 
K frequency bins under common PSD mask constraint. Each player has full knowledge of the channel 
matrices and the following conditions hold: 

1) Player n transmits using a PSD limited by {pn{k) : k = I, ...,K). 

2) The players are using coordinated FDM/TDM strategies. The strategy for player 1 is a vector 
cxi = [ai(l), ...,ai{K)]^ where ai{k) is the proportion of time player 1 uses the k'th frequency 
channel. Similarly, the strategy for player 2 is a vector Q2 = ["2(1), a2(-f^)]^- 

3) The utility of the players is given by 

Rn (a„) = X; «n (k) Rn{k) = an{k) log, (l + M^l!^") . (19) 
k=l k=l ^ ^"^''^ ^ 

By Pareto optimality of the Nash Bargaining solution for each k, a2{k) = 1 — ai{k), so we will only 
refer to a = ai as the strategy for both players. Note, that interference is avoided by time sharing at 
each frequency band, i.e only one player transmits with maximal power at a given frequency bin at any 
time. The allocation of the spectrum using the vector a induces a simple convex optimization problem 
that can be posed as follows 

max («) - Ric) {R2 («) - R2c) 
subject to: < a{k) < 1 Vk, Rnc < Rn (a) Vn. 



since the log of the Nash function (EOt is a convex function the overall problem is convex. Hence, it can 
be solved efficiently using KKT conditions [21]. Assuming that a feasible solution exists it follows from 
the KKT conditions that the allocation is done according to the following rules: 
1) The two players are sharing the frequency bin k, (0 < a{k) < 1) if 

Ri (k) R2 (k) 



Ri{cx)-Ric R2{cy.)-R2C 
2) Only player n is using the frequency bin k, {an {k) = 1), if 



(21) 



Rn jk) ^ R3-n (k) ^22) 

Rn (a) - RnC Rs-n («) " -Rs-n.C ' 

These rules can be further simplified. Let = Ri{k) / R2{k) be the ratio between the rates at each 
frequency bin. We can sort the frequency bins in decreasing order according to L^. From now on we 
assume that when ki < k2 then Lf^^ > Lj^^. If all the values of are distinct then there is at most 
a single frequency bin that has to be shared between the two players. Since only one bin can satisfy 
equation ((2T]) . let us denote this frequency bin as kg, then all the frequency bins 1 < A; < A;^ will only 
be used by player 1, while all the frequency bins kg < k < K will be used by player 2. The frequency 
bin kg has to be shared according to the rules. 

We now have to find the frequency bin that has to be shared between the players if there is a 
solution. Let us define the surplus of players 1 and 2 when using Nash bargaining solution as A = 
Em=i " ("^) -^1 ("^) - ^ic> and B = Y!L=\ (1 - " ("i)) ^2 [m) - R2C, respectively. Note that the 
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ratio, T = A/ B is independent of frequency and is set by the optimal assignment. A-priori F is unknown 
and may not exists. We are now ready to define the optimal assignment of the a's. 
Let Ffc be a moving threshold defined by = Ak/Bk- where 

k K 

Ak=Y,Ri (^) - Ric, Bk= ^2 (m) - R2C- (23) 

m=l m=k+l 

Ak is a monotonically increasing sequence, while B^ is monotonically decreasing. Hence, F^ is also 
monotonically increasing. Ak is the surplus of player 1 when frequencies 1, A; are allocated to player 
1. Similarly B}^ is the surplus of player 2 when frequencies A; + 1, K are allocated to player 2. 

Let A;min = miiife {fc : Afc > 0} , and Aj^ax = miiife {k : Bk < 0}. 

Since we are interested in feasible NBS, we must have positive surplus for both users. Therefore, using 
the allocation rules, we obtain /cmin < ^max and < F < L^^^^. The sequence {F^ : kmin < m < 

kmax — 1} is strictly increasing, and always positive. While the threshold F is unknown, one can use the 
sequences F^ and L{k) to find the correct F. 

If there is a Nash bargaining solution, let kg be the frequency bin that is shared by the players. Then, 
femin ^ kg < fcjnax- Sincc, both playcrs must have a positive gain in the game (A > Ak^^^.^_i,B > Bj^^^^J. 
Let ks be the smallest integer such that L{ks) < F^^, if such kg exists. Otherwise let kg = fcmax- 

Lemma 4.1: The following two statements provide the solution 

1 If a Nash bargaining solution exists for k^i^ < kg < fcmax. then a {kg) is given by a {kg) = 
■max{0,g}, where 

'''' 

2 If a Nash bargaining solution exists and there is no such kg, then kg = kmax and a{kg) = g. 
Based on the pervious lemmas the algorithm is described in table |llll In the first stage, the algorithm 
computes L{k) and sorts them in a non increasing order. Then /cmin, ^maxi^fc) and Bf^ are computed. In 
the second stage the algorithm computes kg and a. 

To demonstrate the algorithm we compute the Nash bargaining for the following example: 
Example V: Consider two players communicating over 2x2 memoryless Gaussian interference channel 
with 6 frequency bins. The players' rates if they are not cooperate is Ric = 15, and i?2C = 10. The 
feasible rates Ri (k) and R2 {k) in each frequency bin with no interference are given in Table ITVl after 
sorting the frequency bins with respect to L^. 

We now have to compute the surplus A^ and B^ for each players. If NBS exists then the players must 
have postive surplus, thus, kmin = 2, and kmax = 4. Since, /c = 4 is the first bin such that F^ > Lj^, 
we can conclude that kg = 4, and a = 0.33 (using lemma |4~T] ) . Thus, players 1 is using frequency bins 
1, 2, and 3, and using 1/3 of the time frequency bin 4. The total rate of players 1 and 2 are 40 i and 48 
respectively. 



We can also give a geometrical interpretation to the solution. In Figure 4(a) we draw the feasible total 
rate that player 1 can obtain as a function of the total rate of player 2. The enclosed area in blue, is 
the achievable utilities set. Since, the frequency bins are sorted according to Lj^ the set is convex. The 
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TABLE III 

Algorithm for computing the 2x2 frequency selective NBS 



: Initialization: Sort the ratios L{k) in decreasing order. 
Calculate the values of Ak,Bk and F^, fcmin, femax, 
If fcmin > fcmax uo NBS exists. Usc Competitive solution. 
Else 

For k = /Cniin tO kmax 1 

if L{k) < Ffc. 

Set ks = k and a's according to the lemmas-This is NBS. Stop 
End 
End 

If no such k exists, set kg = fcmax and calculate g. 
If 5 ^ set Qfeg — g, a{k) — 1, for k < fcmax- Stop. 
Else (g < 0) 

There is no NBS. Use competitive solution. 
End. 
End 



k 


1 


2 


3 


4 


5 
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Ri 


14 


18 


5 


10 


9 


3 


R2 


6 


10 


5 


15 


19 


19 


L{k) 


2.33 


1.80 


1.00 


0.67 


0.47 


0.16 


Ak 


-1 


17 


22 


32 


41 


44 


Bk 


58 


48 


43 


28 


9 


-10 


Vk 


-0.02 


0.35 


0.51 


1.14 


4.56 


-4.40 



TABLE IV 

The rates of the players in each frequency bin after sorting. 



point Rc = Ric) = (10, 15) is the point of disagreement. If the point Rc is inside the achievable 

utiUty set there is a solution. The slope of the boundaries of the achievable utilities set with respect to 
the —X axis is L^. The vector Rc — B connects the point Rc and the point B is with the same slope 
with respect the x axis, this is the geometrical interpretation of (|2T|| . The area of the white rectangular 
is the value of Nash's product function. 

The results can be generalized in several directions: 

First, if the values {L{k) : k = 1, ■■.,K] are not all distinct then if there is a solution one can always 
find allocation such that at most a single frequency has to be shared. 

Second, in the general case of players the optimization problem has similar KKT conditions and 
can be solved using convex optimization algorithm. Moreover, the optimal solution has at most (^) 
frequencies that are shared between different players. This suggests, that the optimal FDM NBS is very 
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(a) The FDM/TDM rate region 



(b) Price of Anarchy for 32 parallel Rayleigh 
fading channels 



Fig. 4. (a) Feasible FDM rate region (blue area), Nash Bargaining Solution (the area of the white rectangular) (b) Per user 
price of anarchy for frequency selective Rayleigh fading channel. SNR=30 dB. 

close to the joint FDM/TDM solution. It is obtained by allocating the common frequencies to one of the 
users. Third, while the method described above fits well to stationary channels, the method is also useful 
when only fading statistics is known. In this case the coding strategy will change, and the achievable 
rate in the competitive case and the cooperative case are given by 



respectively. All the rest of the discussion is unchanged, replacing Rnc and Rn{cxn) by 'R.nC ^ Rii^i-n) 
respectively. This is particularly attractive, when the computations are done in distributed way. In this case 
only channel state distributions are sent between the units. Hence the time scale for this data exchange are 
much longer. This implies that method can be used without a central control, by exchange of parameters 
between the units at a very low rate. 

Fourth, computing the NBS under total power constraint is more difficult to solve. Several ad-hoc 
techniques have been proposed in the literature. Recently, it was shown that for this case there exist an 
algorithm which can find the optimal solution ll22l . 



The basic requirement behind any adaptive approach for spectrum management and co-existence of 
communication networks, is the capability to adaptively shape the spectrum. While ten years ago this 
was beyond the capabilities of commercial communication systems, this is no longer the situation. The 
signal processing hardware available at most of the modern chips is sufficient for this purpose, and 
the marginal cost of this spectrum sensing and shaping capability is rapidly diminishing. The main 
ingredients required to implement game theoretic approaches, are varying. Typically we distinguish three 




) 



(25) 



V. Signal processing and computational issues 
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levels of management: Autonomous, where each unit operated with no exchange of information with 
other units or management centers, distributed, where a management center provides some parameters to 
the units, which then design the spectrum and transmit by themselves, centralized where all the spectrum 
design is performed by a spectrum management center that collects information from units, and performs 
centralized processing. The competitive solutions correspond to the autonomous operation. For these, each 
communication unit (player) is required to have a spectral analysis module, capable of estimating channel 
transfer functions and noise spectrum. The regulated versions of the competitive games such as ASB, 
IPP and FM-IWF belong to this second family of distributed solutions where the spectrum management 
center provides some a-priori network information or pricing functions as well as a list of the desired 
rates. For the distributed solutions, a low rate communication with a center or with adjacent units is 
required like in the Nash bargaining solution of the previous section where only channel distributions 
are exchanged between users. 

Finally, an important system and signal processing issue is synchronization of the various players. This 
is especially important for multi-carrier systems, where inter channel interference can be severe when 
the various units are not locked to a common time and frequency reference. 

VI. Applications 

A. Weak interference: The DSL case 

The DSL channel is an interesting example for testing algorithms emerging from game theoretic 
considerations. The iterative waterfilling algorithm [31 has been successfully implemented for distributed 
spectrum coordination of DSL lines. However the drawbacks caused by the prisoner's dilemma suggest 
that the strictly competitive approach (RA-IWF) is inappropriate for real life applications. Several amend- 
ments have been proposed. The first is the fixed margin iterative waterfilling |i3J. In this algorithm the 
players are provided with a fixed target rate and each user, independently minimizes its total transmit 
power. As shown by Pang et al. [5| this is a generalized Nash game that converges if the interference 
is sufficiently weak. In a generalization of the FM-IWF is proposed, that favors weak users using 
a pricing mechanism termed iterative power pricing. This pricing mechanism improves the performance 
of the FM-IWF. The game theoretic approaches have very good performance when compared to optimal 
spectrum management techniques, as shown in figure |5] 

B. Medium and strong interference - Wireless technologies 

The rapid adoption of wireless services by the public, have caused a remarkable increase in demand 
for reliable high data rate Internet access. This process motivated the development of new technologies. 
New generation of cellular systems like LTE and WiMax operating in the licensed band will be lunched 
in the near future. In the unlicensed band, 802. UN with MIMO technology are going to become part 
of our daily life. The capacity of future wireless data networks will inevitably be interference limited 
due, the the limited radio spectrum. It is clear that any cooperation between the different networks 
or base stations sharing the same spectral resource can offer significant improvement in the utilization 
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(a) Simulation setup (b) Rate region 



Fig. 5. (a) Simulation setup. 3 users at each location, (b) Rate regions of FM IWF, IPP and OSB. The optimal OSB is 
centralized and computationally very expensive. It is given as a reference to the optimal performance. 

of the radio resources. Even in the same cell, cooperation between sectors can improve the over all 
spectral efficiency (bit/Hz/sec ./sector). OFDMA technology is capable to allocate efficiently frequency 
bins based on the channel response of the user. In ll46l . a noncooperative game approach was employed 
for distributed sub-channel assignment, adaptive modulation, and power control for multi-cell OFDM 
networks. The goal was to minimize the overall transmitted power under maximal power and per user 
minimal rate constraints. Based on simulation results, the proposed distributed algorithm reduces the 
overall transmitted power in comparison with pure water-filling scheme for a seven-cell case. Kwon and 
Lee BTl presented a distributed resource allocation algorithm for multi-cell OFDMA systems relying 
on a noncooperative game in which each base station tries to maximize the system performance while 
minimizing the cochannel interference. They proved that there exists a Nash equilibrium point for the 
noncooperative game and the equilibrium is unique in some constrained environment. However, Nash 
equilibrium achieved by the distributed algorithm may not be as efficient as the resource allocation 
obtained through centralized optimization. To demonstrate the advantage of the Nash bargaining solution 
over competitive approaches for a frequency selective interference channel we assume that two users 
are sharing a frequency selective Rayleigh fading channel. The direct channels have unit fading variance 
and SNR of 30 dB. The users suffer from cross interference. The cross channels fading variance was 
varied from -10 dB to dB (cr^ = 0.1, ...1). The spectrum consisted of 32 parallel frequency bins 
with independent fading matrices. At each interference level of interference af = a^^^ , = (t^^^ we 
randomly picked 25 channels (each comprising of 32 2x2 random matrices). The results of the minimal 
relative improvement (l26l ) are depicted in figure |4(b)[ 

A^i„ = min {R^'/R?, R^'/R^} ■ (26) 

The relative gain of the Nash bargaining solution over the competitive solution is 1.5 to 3.5 times, which 
clearly demonstrates the merits of the method. 
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